Papers with entity linking
Copied to clipboard
| Challenge: | Existing work has shown advantages of incorporating knowledge graphs (KGs) into BERT for various NLP tasks. |
| Approach: | They propose to integrate knowledge graphs into BERT to train entity embeddings to include rich information of factual knowledge. |
| Outcome: | The proposed models perform very well when combined with context. |
Copied to clipboard
| Challenge: | InsightBuddy-AI is a system for extracting medication mentions and their associated attributes. |
| Approach: | They propose a system for extracting medication mentions and their associated attributes . they use stacked and voting ensembles built upon pre-trained language models . |
| Outcome: | The proposed system outperforms fine-tuned models in the extraction of medication mentions and associated attributes. |
Copied to clipboard
| Challenge: | a tutorial explores the commonalities in the challenges and solutions developed to address information extraction from the World Wide Web. |
| Approach: | This tutorial examines methods for extracting information from the World Wide Web . it explores the commonalities in the challenges and solutions developed to address these different forms of text . |
| Outcome: | This paper examines the commonalities in the challenges and solutions developed to address the World Wide Web. |
Copied to clipboard
| Challenge: | Money laundering (AML) is the process of transferring criminal and illegal proceeds into ostensibly legitimate assets. |
| Approach: | They propose a framework that uses deep learning to augment AML monitoring and investigation . money laundering is the process of transferring criminal and illegal proceeds into ostensibly legitimate assets . |
| Outcome: | The proposed framework reduces time and cost by 30% compared to existing methods . money laundering is the world's third largest "industry" |
Copied to clipboard
| Challenge: | Experimental results show that a model that can predict ultra-fine types can be crowd-sourced . head words indicate the type of the noun phrases they appear in, and are important for context-sensitive tasks . |
| Approach: | They propose a task where sentences are given with an entity mention . they introduce a new type of distant supervision: head words, which indicate the type of noun phrases they appear in. |
| Outcome: | The proposed model can predict ultra-fine types at varying granularity and performs well on a fine-grained entity typing benchmark. |
Copied to clipboard
| Challenge: | Existing methods to incorporate hierarchical information into knowledge bases have yielded little benefit. |
| Approach: | They propose methods to integrate hierarchical information using real bilinear mappings . they also propose two new datasets containing wide and deep hierarchies . |
| Outcome: | The proposed methods improve on flat predictions and fine-grained entity typing on FIGER dataset. |
Copied to clipboard
| Challenge: | Entity linking systems depend on candidate sets for their performance, but a comprehensive comparative analysis of these systems is lacking. |
| Approach: | They propose a black-box benchmark and a method to evaluate all state-of-the-art entity linking methods. |
| Outcome: | The proposed approach reduces the inference time and memory footprint of some models. |
Copied to clipboard
| Challenge: | CogNet is a knowledge base that integrates three types of knowledge: linguistic knowledge, world knowledge and commonsense knowledge. |
| Approach: | They propose an information extraction toolkit called CogIE that is a bridge connecting raw texts and CogNet. |
| Outcome: | The proposed toolkit can ground raw texts to CogNet and leverage different types of knowledge to enrich extracted results. |
Copied to clipboard
| Challenge: | Recent years Natural Language Processing community has seen a surge of interest in fine-grained entity typing (FET) given an entity mention (i.e. a sequence of token spans representing an entity), FET aims at uncovering its contextdependent type. |
| Approach: | They propose an efficient Knowledge Constraint Fine-grained Entity Typing Annotation Tool which further improves the entity typing process through entity linking together with some practical functions. |
| Outcome: | The proposed tool improves the entity typing process by linking the candidate types with some practical functions. |
Copied to clipboard
| Challenge: | Entity recognition is a critical first step to a number of clinical NLP applications, such as entity linking and relation extraction. |
| Approach: | They propose to use general and domain-specific information to combine general and specific information to create a new entity recognition method. |
| Outcome: | The proposed method produces a state-of-the-art result on a newly released dataset, MedMentions. |
Copied to clipboard
| Challenge: | Existing methods for multilingual entity linking are limited by textual contexts and limited resources. |
| Approach: | They propose a testbed system for multilingual multimodal entity linking using BBC news articles paired with corresponding images in five languages. |
| Outcome: | The proposed system improves accuracy for entities with ambiguous textual contexts and models with weak multilingual abilities. |
Copied to clipboard
| Challenge: | Existing studies have explored the use of entity linking (EL) in downstream tasks. |
| Approach: | They propose a modularized entity linking toolkit for easy task adaptation. |
| Outcome: | The proposed toolkit achieves significantly better accuracy and less time and spaceconsumption than existing methods. |
Copied to clipboard
| Challenge: | Existing work on question answering over knowledge bases limited the search space to a subset of KBs . a retrieval-and-rerank framework is used to access KB and rerank retrieved candidates with more powerful neural networks. |
| Approach: | They propose to share a BERT encoder across all three sub-tasks and define task-specific layers on top of the shared layer. |
| Outcome: | The proposed method improves accuracy and accuracy on the SimpleQuestions dataset and the FreebaseQA dataset. |
Copied to clipboard
| Challenge: | In Natural Language Processing, entity linking (EL) has centered around Wikipedia, but yet remains underexplored for the job market domain. |
| Approach: | They propose to use a bi-encoder and an autoregressive model to link fine-grained span-level skill mentions to a specific taxonomy entry to quantify labor market demands. |
| Outcome: | The proposed model outperforms GENRE in strict evaluation, but performs better in loose evaluation. |
Copied to clipboard
| Challenge: | a novel historical Chinese dataset is used for named entity recognition, entity linking and entity relations. |
| Approach: | They propose a historical Chinese dataset for named entity recognition, entity linking, coreference and entity relations . they use Chinese newspapers from 1872 to 1949 and multilingual bibliographic resources from the same period . |
| Outcome: | The proposed dataset covers different styles and language uses, and is the largest historical Chinese NER dataset with manual annotations from this transitional period. |
Copied to clipboard
| Challenge: | Short textual descriptions of entities provide summaries of their key attributes but generating entity descriptions can be challenging since information is scattered across multiple sources with varied content and style. |
| Approach: | They propose to generate an entity summary description from 37K entities from Wikipedia and Fandom, paired with nine evidence documents on average. |
| Outcome: | The proposed task is entity-centric, more abstractive, and covers a wide range of domains. |
Copied to clipboard
| Challenge: | Existing approaches to entity linking represent each entity with a single vector, but instead use a contextualized mention-encoder that learns to place similar mentions of the same entity closer in vector space than mentions from different entities. |
| Approach: | They propose an instance-based nearest neighbor approach to entity linking that allows for a contextualized mention-encoder to learn to place similar mentions of the same entity closer in vector space than mentions from different entities. |
| Outcome: | The proposed approach outperforms all other systems on two multilingual benchmarks and is simpler to train and interpretable. |
Copied to clipboard
| Challenge: | Several literature surveys have been done to understand how open knowledge graphs are constructed, evaluated, and integrated. |
| Approach: | They analyze 4445 scholarly articles retrieved from Scopus and analyze their results to identify trends, patterns, and impact of research in this field. |
| Outcome: | The results reveal an ever-increasing number of publications on open knowledge graphs published every year, especially in developed countries (+50 per year). |
Copied to clipboard
| Challenge: | Existing approaches to transliteration generation require a large number of training examples. |
| Approach: | They propose a bootstrapping algorithm that uses constrained discovery to improve generation . they show that the model can be used with as few as 500 training examples . |
| Outcome: | The proposed method improves on nine languages written in a unique script. |
Copied to clipboard
| Challenge: | Existing work on simple question answering over knowledge graphs involves increasingly complex NN architectures. |
| Approach: | They propose to decompose the problem into entity detection, entity linking, relation prediction, evidence combination and heuristics. |
| Outcome: | The proposed approach outperforms existing models and benchmarks on a simple QA task. |
Copied to clipboard
| Challenge: | In the human body, various substances (entities) such as proteins and compounds interact and regulate each other, forming huge pathway networks. |
| Approach: | They present a system that extracts and visualizes a disease network derived through regulation events found in scientific articles on idiopathic pulmonary fibrosis. |
| Outcome: | The proposed system extracts and visualizes a disease network from biomedical articles on idiopathic pulmonary fibrosis (IPF) it includes two-dimensional (2D) and 3D visualizations of the constructed disease network. |
Copied to clipboard
| Challenge: | Entity linking aims to link entity mentions in texts to knowledge bases, but existing methods rely on local contexts to resolve entities independently. |
| Approach: | They propose a neural model for collective entity linking that integrates local contextual features and global coherence information to improve the computation efficiency. |
| Outcome: | The proposed model improves its performance on five publicly available datasets and can be used to train on Wikipedia hyperlinks to avoid overfitting and domain bias. |
Copied to clipboard
| Challenge: | a proposed entity linking model that disjointly applies MD and ED from the same contextualized BERT embeddings is able to generalize better. |
| Approach: | They propose an entity linking (EL) model that jointly learns mention detection (MD) and entity disambiguation (ED) they propose to use task-specific heads on top of shared BERT contextualized embeddings to learn MD and ED. |
| Outcome: | The proposed model achieves state-of-the-art results across a standard EL dataset and under a setting where hand-crafted candidate sets are not available. |
Copied to clipboard
| Challenge: | Existing work on entity linking relies on a knowledge base that is not known at training time. |
| Approach: | They propose a method to flexibly convert entities with several attribute-value pairs from arbitrary KBs into flat strings and use it to generalize the model. |
| Outcome: | The proposed model is 12% more accurate than baseline models on English datasets. |
Copied to clipboard
| Challenge: | KnowledgeNet provides text exhaustively annotated with facts . high-quality KBs still rely almost exclusively on human-curated structured or semi-structured data. |
| Approach: | They propose five baseline approaches to populating a knowledge base with facts . the best approach achieves an F1 score of 0.50, significantly outperforming a traditional approach by 79% . |
| Outcome: | The best approach achieves an F1 score of 0.50, outperforming a traditional approach by 79%, indicating the dataset is challenging. |
Copied to clipboard
| Challenge: | Entity linking is a task of assigning ambiguous mentions in textual input to entities in knowledge bases. |
| Approach: | They propose a framework to align mentions in text to entities in knowledge bases . they use unsupervised clustering to select key views from descriptions . |
| Outcome: | The proposed framework achieves state-of-the-art on the zero-shot entity linking dataset. |
Copied to clipboard
| Challenge: | Recent work on entity linking has focused on the zero-shot scenario where at test time the entity mention to be labelled is never seen during training. |
| Approach: | They propose a transformational biencoder that integrates a transform into BERT to perform a zero-shot transfer from the source domain to the target domain. |
| Outcome: | The proposed model performs a zero-shot transfer from the source domain to the target domain on a benchmark dataset and achieves new state-of-the-art. |
Copied to clipboard
| Challenge: | Context Tracking is a computational task for human-human conversations . it involves identifying important entities and keeping track of their properties and relationships . |
| Approach: | They propose to use a human-human conversation corpus for context tracking with people and location annotations to model the conversation's context. |
| Outcome: | The proposed model is based on a large human-human conversation corpus with people and location annotations. |
Copied to clipboard
| Challenge: | Generative approaches powered by large language models have demonstrated emergent abilities in tasks that require complex reasoning abilities. |
| Approach: | They propose a sequence-to-sequence training objective with instruction-tuning that enables casual language models to perform entity linking over knowledge bases. |
| Outcome: | The proposed framework outperforms existing approaches with +6.8 F1 points gain on average and huge advantage in training data efficiency and compute consumption. |
Copied to clipboard
| Challenge: | Biomedical entity linking is a task of linking entities in biomedical documents to referent entities in a knowledge base. |
| Approach: | They propose an efficient convolutional neural network with residual connections for biomedical entity linking. |
| Outcome: | The proposed model achieves comparable or even better linking accuracy on five public datasets while having about 60 times fewer parameters. |
Copied to clipboard
| Challenge: | Biomedical event extraction requires domain-specific knowledge and deep understanding of complex contexts. |
| Approach: | They propose a knowledge base-driven tree-structured long short-term memory networks framework . tree-LSTM framework incorporates dependency structures and entity properties from ontologies . |
| Outcome: | The proposed framework is based on the BioNLP shared task with Genia dataset and achieves state-of-the-art results. |
Copied to clipboard
| Challenge: | Existing approaches to identifying and linking funding entities are suboptimal for the funding domain. |
| Approach: | They propose an entity linking model that can perform NIL prediction and overcome data scarcity issues in a time and data-efficient manner. |
| Outcome: | The proposed model outperforms existing baselines and overcomes data scarcity issues in a time and data-efficient manner. |
Copied to clipboard
| Challenge: | Existing models for knowledge-intensive language tasks require access to large, external knowledge sources. |
| Approach: | They propose a benchmark for knowledge-intensive language tasks (KILT) they test a shared dense vector index coupled with a seq2seq model to generate disambiguated text. |
| Outcome: | The proposed model outperforms tailor-made approaches on fact checking, open-domain question answering and dialog by generating disambiguated text. |
Copied to clipboard
| Challenge: | Existing approaches to linking entities ignore relationships between entities in biomedical knowledge bases. |
| Approach: | They propose a model which can link mentions of unseen entities using learned representations of entities. |
| Outcome: | The proposed model improves on the largest publicly available biomedical dataset by 3.0 points of accuracy and 2.3 points of reliability. |
Copied to clipboard
| Challenge: | Existing studies on the explainability of ICD coding rely on attention-based rationales and qualitative assessments conducted by physicians. |
| Approach: | They propose to evaluate the explainability of rationales in ICD coding using a multi-granular rationale-annotated dataset. |
| Outcome: | The proposed model improves the explainability of rationales in ICD coding by using human-annotated rationale-announced rationale models. |
Copied to clipboard
| Challenge: | Named entity recognition (NER), named entity linking and discourse modeling are crucial aspects of natural language understanding for open domain dialogue systems. |
| Approach: | They present an annotated multi-domain corpus for linking entities in open-domain dialogue . they use dialogue context and anaphora resolution to assess the effectiveness of the task . |
| Outcome: | The OpenEL corpus is an annotated multi-domain corpus for linking entities in open-domain dialogue . the system Flair + BLINK has the best performance with a 0.65 F1 score . |
Copied to clipboard
| Challenge: | Entity linking is a fundamental task in natural language processing, says nigel kilgstrom . existing corpora for entity linking in china are lacking and deficient, he says . kilsmstrom: a new method for entity disambiguation can be developed for Chinese . |
| Approach: | They build a Chinese corpus of multi-domain long text for entity linking . they evaluate the difficulty of documents with respect to entity linking using a measure . |
| Outcome: | The proposed corpus is based on 100 documents from diverse domains and is publicly accessible. |
Copied to clipboard
| Challenge: | Entities are a central element of knowledge bases and are used in many knowledge-centric tasks including text analysis. |
| Approach: | They propose to use entity spaces to represent a set of associated entities with near-identity to provide a handle to an amorphous grouping of entities. |
| Outcome: | The proposed representations improve recall of entity linking in English by using disambiguation pages. |
Copied to clipboard
| Challenge: | Recent studies have shown that using prompts to utilize language models to perform downstream tasks is more effective than using token-level methods such as PET. |
| Approach: | They propose to use a BERT original pre-training task abandoned by RoBERTa and other models to construct a sentence-level prompt-based method that does not need to fix the length of the prompt or the position to be predicted. |
| Outcome: | The proposed method performs better than PET and EFL on a BERT pre-training task and is comparable to other prompt-based methods. |
Copied to clipboard
| Challenge: | Citation recommendation tasks involve recommending citations within their specific contexts. |
| Approach: | They propose to use arXiv.org's citation-dependent evaluation data set to evaluate citations . their data set is characterized by the fact that it exhibits almost zero noise in its extracted content . |
| Outcome: | The proposed data set exhibits almost zero noise in extracted content and all citations are linked to their correct publications. |
Copied to clipboard
| Challenge: | Dense retrieval methods have shown great promise over sparse methods in a range of NLP problems. |
| Approach: | They propose to use dense phrase retrieval to learn coarse-level retrieval including passages . they show phrase retrievals can be fine-tuned for more coarse-grained retrieval units . |
| Outcome: | The proposed method improves passage retrieval accuracy and QA performance with fewer passages. |
Copied to clipboard
| Challenge: | Existing approaches to question answering on knowledge graphs are based on a modularized sequential approach where errors in one module lead to the accumulation of errors in downstream modules. |
| Approach: | They propose a multi-task BERT based Neural Machine Translation model to address these challenges. |
| Outcome: | The proposed model can answer questions over a knowledge graph on one publicly available and one proprietary dataset. |
Copied to clipboard
| Challenge: | Existing approaches to self-supervised learning of biomedical entities are limited in the biomedic domain. |
| Approach: | They propose a pretraining scheme that self-aligns the representation space of biomedical entities. |
| Outcome: | The proposed framework achieves state-of-the-art on six MEL benchmarking datasets. |
Copied to clipboard
| Challenge: | Existing closed IE datasets are built using Wikipedia, but they have limitations when applied to web domains. |
| Approach: | They propose to annotate 25K triples from WebIE through crowdsourcing and introduce mWebIE, a translation of the annotated set in four other languages. |
| Outcome: | The proposed model trains on 1.6M sentences from the English Common Crawl corpus and includes negative examples to better reflect the data on the web. |
Copied to clipboard
| Challenge: | Spatial domain queries have unique properties making them more challenging for language understanding than common conversational queries. |
| Approach: | They propose a language understanding framework for spatial domain queries that jointly learns the intent detection and entity linking tasks on a voice assistant service. |
| Outcome: | The proposed framework outperforms baseline methods with a significant margin. |
Copied to clipboard
| Challenge: | Pre-trained language models (PLMs) have shown their superiority by pre-training on unstructured text corpus and then fine-tuning on downstream tasks. |
| Approach: | They propose a Knowledge-Enhanced Pre-trained LanguagE model with Topic entity awareness that incorporates the interactions between tokens and mentioned entities in pre-training. |
| Outcome: | The proposed model incorporates the interactions between tokens and mentioned entities in pre-training and is more effective on entity-centric tasks. |
Copied to clipboard
| Challenge: | Existing models for diverse-mode entity linking (EL) work well on per modality configurations, but it is more challenging to design a unified model for diverse modality. |
| Approach: | They propose a generative diverse-modal model that integrates text, image and table . they propose combining a multimodal encoder-decoder paradigm with a fine-tuning GDMM . |
| Outcome: | The proposed model outperforms state-of-the-art models by 8.51 F1 on average for diverse-modal EL. |
Copied to clipboard
| Challenge: | Entity linking is a fundamental task in Natural Language Processing (NLP), connecting mentions within unstructured contexts to their corresponding entities in a Knowledge Base (KB). |
| Approach: | They propose a dual-encoder framework that can efficiently match mentions to two-encoding frameworks by a global-view. |
| Outcome: | The proposed framework achieves state-of-the-art on several entity linking benchmarks. |
Copied to clipboard
| Challenge: | Named entity linking is the task of identifying mentions of named things in text . e.g., "Barack Obama" or "New York" are examples of named entities . |
| Approach: | They propose an end-to-end named entity linker that uses BILSTM models for mention detection and a PageRank algorithm for entity linking. |
| Outcome: | The proposed named entity linker performs better than the previous generation, and is trilingually better. |
Copied to clipboard
| Challenge: | Existing entity embeddings are effective, but too distinctive for linking models to learn contextual commonality. |
| Approach: | They propose a method to inject fine-grained semantic information into entity embeddings . they use word embedds of type words to generate semantic embeddngs based on existing embeddables a sample of semantic information is injected into the embedded entities . |
| Outcome: | The proposed method reduces the distinctiveness of existing embeddings and improves performance. |
Copied to clipboard
| Challenge: | Entity linking is an important task for language understanding. |
| Approach: | They propose a fully unsupervised model that generates a guided summary of the contexts conditioning on a mention and then casts the task to a multiple-choice problem. |
| Outcome: | The proposed model achieves state-of-the-art performance on existing datasets and exiting datasets. |
Copied to clipboard
| Challenge: | Existing methods for fine-grained entity typing require a large tag set and knowledge of the context. |
| Approach: | They propose a deep neural model that uses context and information from entity linking to improve fine-grained entity typing. |
| Outcome: | The proposed model achieves 5% absolute strict accuracy improvement over the state of the art on two datasets. |
Copied to clipboard
| Challenge: | Entity linking is a key component of structured data creation by linking spans of text to an ontology or knowledge source. |
| Approach: | They propose to use structured prediction for entity linking to classify each input token as an entity and aggregate the token predictions. |
| Outcome: | The proposed system outperforms the state-of-the-art on the commonly used AIDA benchmark dataset for entity linking to Wikipedia. |
Copied to clipboard
| Challenge: | Existing approaches for cross-lingual entity linking are not suitable for English. |
| Approach: | They propose a candidate generation problem in cross-lingual entity linking with a focus on low-resource languages. |
| Outcome: | The proposed solution outperforms the state-of-the-art approach on 9 real-world datasets and query types. |
Copied to clipboard
| Challenge: | Existing methods for integrating knowledge graphs into pre-trained language models have been poorly implemented. |
| Approach: | They propose a self-supervised entity masking scheme that exploits relational knowledge underlying the text. |
| Outcome: | The proposed model achieves improved performance on five benchmarks, including question answering and knowledge base completion. |
Copied to clipboard
| Challenge: | Prior research in event linking has mainly borrowed methods from entity linking, overlooking distinct features of events. |
| Approach: | They propose an argument-aware method to improve event linking models by augmenting input text with tagged event argument information. |
| Outcome: | The proposed method improves in-KB and out-of-KB queries and training examples. |
Copied to clipboard
| Challenge: | Entity linking systems rely on three sources of information: 1) similarity between mention string and entity name; 2) similarity of context of document to entity; 3) broader information about knowledge base; 4) contextual information; 5) semantic information; and 6) semantic information. |
| Approach: | They propose an approach to linking medical concepts to a medical concept ontology that leverages recent work in contextualized neural models. |
| Outcome: | The proposed approach outperforms a baseline approach and provides better initialization for the ranker. |
Copied to clipboard
| Challenge: | Existing entity linking models struggle to link new expressions to entities in the dynamic nature of human language. |
| Approach: | They propose a task to resolve emerging mentions to dynamic entities and a benchmark to evaluate their model's adaptability to new expressions. |
| Outcome: | The proposed method outperforms baselines on QA task with resolved mentions and improves retrieval-augmented generation performance. |
Copied to clipboard
| Challenge: | Entity disambiguation (ED) is the last step of entity linking when candidate entities are reranked according to the context they appear in. |
| Approach: | They propose a dataset that includes 16K short text snippets annotated with entity mentions to evaluate EL models. |
| Outcome: | The proposed dataset shows that the performance of EL systems is overestimated . the results show that the EL system performance is significantly better on the ShadowLink benchmark . |
Copied to clipboard
| Challenge: | Using a partially reannotated subset of the Armed Conflict Location & Event Data, we analyze 39,786 conflict events across 20 languages and 171 countries. |
| Approach: | They propose a large-scale conflict event dataset with extensive coverage of region-specific entities. |
| Outcome: | The proposed method detects event arguments and entities through holistic document understanding and normalizes them across the multilingual dataset. |
Copied to clipboard
| Challenge: | Current entity linking tasks rely on textual information, but entities usually exist in textual, audio, and visual contexts in real-world data such as social media and video websites. |
| Approach: | They propose a speech entity linking task to recognize mentions from speech and link them to entities in knowledge bases. |
| Outcome: | The proposed model outperforms the existing models on the TED-EL dataset, scoring an F1 score of 60.68%. |
Copied to clipboard
| Challenge: | Entity linking is a well-established task in NLP consisting of associating entity mentions with entries in a knowledge base. |
| Approach: | They propose a benchmark that reframes entity linking as a binary entity retrieval task and uses a knowledge base to evaluate model performance. |
| Outcome: | The proposed benchmark aims to bridge the challenges in entity linking in noisy domains such as social media. |